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Serial No. 09/237,646 

Interferences consider the arguments presented herein and 
reverse the Examiner's rejection. 

I. REAL PARTY IN INTEREST 

The appeal is made on behalf of Assignee, 
International Business Machines Corporation and the 
inventors, Vittorio Castelli, Chung Sheng Li, and John R. 
Smith, who are real parties in interest with respect to the 
subject patent application. 

II. RELATED APPEALS AND INTERFERENCES 

There are no pending related appeals or interferences 
with respect to the subject patent application. 

A prior Notice of Appeal was filed on October 30, 2003 
and an Appeal Brief was filed on December 30, 2003. In 
response to the Appeal Brief, the Examiner re-opened 
prosecution, resulting in withdrawal of the Appeal. No 
decision was rendered by the Board of Patent Appeals and 
Interferences . 
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III. STATUS OF CLAIMS 

There are nine (9) claims pending in the subject 
patent application, numbered 1-4, 9-12 and 18. No claims 
stand allowed. Claims 5-8 and 13-17 were withdrawn from 
consideration in response to a restriction requirement dated 
December 1, 2005 (nearly five years after the first Office 
Action) . A complete copy of the claims involved in the 
appeal is attached hereto. 



IV. STATUS OF AMENDMENTS 

There are no unentered amendments filed after final 
rejection for the application. 

V. SUMMARY OF INVENTION 

The invention which is the subject of the remaining 
pending claims is a computerized method, apparatus, and 
program storage device for performing a method for 
retrieving multidimensional data from a database in response 
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to a user query. Independent Claims 1, 9 and 18 recite the 
method, program storage device and system, respectively. 

Independent Claim 1 

The method for retrieving multidimensional data from a 
database in response to a user query, as recited in 
independent Claim 1, includes a first step of searching the 
database to retrieve data based on the user query (step 201 
of Fig. 2, page 10, lines 4-5 and page 17, lines 2-4) . 
Retrieved data is presented to the user and user input based 
on the retrieved data is received (step 203 of Fig. 2; page 
9, lines 16-19; page 10, lines 5-6 and page 16, lines 9-10) . 
The database is then transformed based on the user input to 
generate a transformed database, wherein the transforming 
comprises at least one of modifying a linear transform 
matrix of the database, transforming the feature space of 
the database, changing distance/similarity measures within 
the database, and changing weighting features within the 
database (steps 204-205; page 10, lines 6-8; page 16, lines 
5-11; page 17, lines 13-16; page 20, line 2-page 23, line 
11; Fig. 6 and page 24, lines 1-8). Once the database has 
been transformed, the method successively searches the 
transformed database to retrieve data (page 17, lines 17- 
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19); and iteratively repeats steps b through e until the 
query is satisfied (steps 206, 207 and 203-205 of Fig. 2; 
page 10, line 8 and page 18, lines 3-4). 

Independent Claim 9 

Claim 9 recites a program storage device (page 33, 
lines 1-16) for causing a machine to perform the method as 
recited in independent Claim 1. The method for retrieving 
multidimensional data from a database in response to a user 
query, as recited in independent Claim 1, includes a first 
step of searching the database to retrieve data based on the 
user query (step 201 of Fig. 2 and page 17, lines 2-4). 
Retrieved data is presented to the user and user input based 
on the retrieved data is received (step 203 of Fig. 2; page 
9, lines 16-19; page 10, lines 5-6 and page 16, lines 9-10) . 
The database is then transformed based on the user input to 
generate a transformed database, wherein the transforming 
comprises at least one of modifying a linear transform 
matrix of the database, transforming the feature space of 
the database, changing distance/similarity measures within 
the database, and changing weighting features within the 
database (steps 204-205, page 16, lines 5-11, page 17, lines 
13-16, page 21, line Fig. 6 and page 24, lines 1-8) . Once 
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the database has been transformed, the method successively 
searches the transformed database to retrieve data (page 17, 
lines 17-19); and iteratively repeats steps b through e 
until the query is satisfied (steps 206, 207 and 203-205 of 
Fig. 2 and page 18, lines 3-4) . 

Independent: Claim 18 

Claim 18 recites a system (106 of Fig. 1 and page 12- 
line 9 through page 13, line 3) for retrieving 
multidimensional data from a database in response to a user 
query. The system comprises a search component for 
searching the database to retrieve data based on said query 
(similarity retrieval engine 103 of Fig. 1), a presentation 
component for presenting retrieved data to user and receiver 
component for receiving user input (database management 
system 104 for providing data to the client system 101 and 
for receiving user feedback) , a transformation component 
for transforming the database based on said user input to 
generate a transformed database (the spatial indexing engine 
107 in association with 108 and 110-112) . 
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VI. GROUND OF REJECTION TO BE REVIEWED 

Appellants seek review not only of the present grounds 
of rejection, but also of the Examiner's decision to issue a 
restriction requirement after nearly five years of 
prosecution of the same set of claims, of the "final" status 
of the most recent Office Action, and of the Examiner's 
refusal to withdraw the Final Office Action. 

The grounds of rejection in the Final Office Action 
included the following: 

-Claims 1-2, 9-10 and 18 have been rejected under 35 USC 
102(a) as being anticipated by U.S. Patent 5,963,940 of 
Liddy, et al (hereinafter "Liddy") ; 

-Claims 1, 9 and 18 have been rejected under 35 USC 102(e) 
as anticipated by U.S. Patent 5,852,823 of De Bonet 
(hereinafter "De Bonet") ; 

-Claims 1-2, 9-10 and 18 have been rejected under 35 USC 
103(a) as being unpatentable over Liddy in view of U.S. 
Patent 5,983,237 of Jain (hereinafter "Jain"); 
-Claims 3-4 and 11-12 have been rejected under 35 USC 103(a) 
as being unpatentable over Liddy in view of Jain and further 
in view of U.S. Patent 5,845,278 of Kirsch (hereinafter 
"Kirsch") ; 
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-Claims 3-4 and 11-12 have been rejected under 35 USC 103(a) 
as being unpatentable over Liddy in view of Kirsch; 
-Claims 2 and 10 have been rejected under 35 USC 103(a) as 
being unpatentable over De Bonet in view of Jain; and 
-Claims 3-4 and 11-12 have been rejected under 35 USC 103(a) 
as being unpatentable over De Bonet in view of Jain and 
further in view of Kirsch. 

VII. ARGUMENT 

The restriction requirement 

Applicants respectfully assert that the Examiner has 
made repeated errors in prosecuting the subject application, 
in spite of Applicants 1 continued efforts to advance the 
prosecution of the application. Applicants had submitted 
six (6) responses to non-final actions between May of 2001 
and May of 2003 prior to the filing of a Notice of Appeal in 
October of 2003. During that time, numerous efforts were 
made to assist the Examiner in understanding the language of 
the claims, the teachings of the cited art, and the MPEP 
standards for generating Office Actions, largely without the 
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necessity of any claims 1 amendments since the cited art did 
not anticipate or obviate the language of the claims. 
During that time, a Declaration of Prior Invention (attached 
in the Evidence Appendix) was also filed. After the filing 
of the Appeal Brief in October of 2003 , and pursuant to 
multiple telephone interviews with Examiner Truong and her 
then-supervisor Jean Corrielus, the Final Office Action of 
July 30, 2003 was withdrawn and a new Office Action was 
generated on March 11, 2004. The newly generated Office 
Action was erroneously indicated as a Final Office Action 
and was subsequently withdrawn after yet another telephone 
interview. 

Examiner Truong generated a non-final Office Action on 
June 22, 2004 citing new grounds for rejection of Claims 1, 
2, 9 and 10, indicating that Claims 5-8 were allowed, and 
indicating that Claims 3, 4, 11 and 12 were allowable. 
After Applicants filed a response dated September 22, 2004, 
however, the Examiner next generated a Requirement for 
Restriction on December 1, 2005... over five years after the 
first office action and continued prosecution on the same 
core set of claims. Applicants believe that it was both 
capricious and retaliatory of the Examiner to generate a 
Restriction Requirement after five years of prosecution of 
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the claims in the one application and after indicating 
allowability of claims drawn to both the method and the 
apparatus. Applicants also believe that it was unreasonable 
of the Examiner to allow over 14 months to pass between the 
receipt of Applicants 1 Amendment (dated 9/22/2004) and the 
next Office Action, namely the Requirement for Restriction. 
Appellants contend that they should not be forced to incur 
additional filing expenses for prosecution of the withdrawn 
claims, when those claims have, in fact, been examined 
repeatedly over the five years preceding the Requirement for 
Restriction. 

Accordingly, Appellants seek to have the status of the 
withdrawn claims, Claims 5-8 and 13-17, returned to the same 
status that the claims had prior to June 22, 2004. 

Withdrawal of the "final" status of the Office Action 

Most recently, the Examiner issued a Final Office 
Action on April 6, 2006 in response to the Election filed 
January 3, 2006. Applicants believe that the Examiner erred 
in issuing the Office Action as a Final Office Action since 
the "Office Action Summary" of the previous Office Action 
(dated 6/22/04) had been inconsistent with the conclusions 
reached in the "Detailed Action" of that action. Although 
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Applicants had responded to that Action, clarification was 
required, requested and should have been provided in the 
form of a non-final action. Applicants believe that the 
final status of the Office Action was inappropriate. 

Appellants further assert that the Final Office Action 
was flawed as detailed hereinafter. The Examiner had 
rejected Claims 1-2, 9-10 and 18 under 35 USC 102(e) as 
anticipated by Liddy (sections 3-4 on pages 4-8 of the 
Office Action, not including the erroneously-labeled section 
4 which begins on page 8 and related to a different ground 
for rejection) . By concluding that Liddy anticipated the 
claim language, the Examiner necessarily concluded that 
Liddy taught each and every claim feature. However, the 
Examiner later stated, in the section labeled 6 on pages 10- 
14, that Claims 1-2, 9-10 and 18 were rejected under 35 USC 
103(a) as being unpatentable over Liddy in view of Jain. 
The Examiner expressly stated, on page 12 and on page 14 
that "Liddy does not explicitly the (sic) claimed limitation 
'retrieving multidimensional data from a database in 
response to a user query 1 ". Clearly the Examiner erred in 
rejecting the claim language as anticipated by Liddy and 
then acknowledging that Liddy did not teach some of the 
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claim language. Applicants believe that the flawed Final 
Office Action should have been withdrawn. 

Applicants further note that the Examiner had, in the 
previous Non-Final Office Action of 6/22/2004, rejected 
Claims 1, 2, 9 and 10 as unpatentable over Liddy, 
acknowledging that "Liddy does not explicitly teach the 
claimed limitation of "repeating step b through e until the 
results for said query is satisfied by the user". However, 
in the more recent anticipation rejection, the Examiner 
reached a conclusion that Liddy anticipated the claim 
language, which conclusion was, and is, inconsistent with 
the previous obviousness rejection. Applicants reiterate 
that the Office Action was flawed and should have been 
withdrawn. 

Appellants bring to the Board' s attention the fact 
that, in response to a Pre-Appeal Brief Request for Review 
filed with the Notice of Appeal on 7/6/2006, a Pre-Appeal 
Brief conference was held. Multiple versions of the Notice 
of Panel Decision from Pre-Appeal Brief Review were 
generated, with inconsistent status indicated (copies 
attached in the Evidence Appendix) . The undersigned 
attorney conducted several telephone interviews with 
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Examiner Truong to clarify the results of the Pre-Appeal 
Brief Review conference. 

It appears that the rejections under 35 USC 102(e) 
rejecting Claims 1-2, 9-10 and 18 have been withdrawn. 
However, all of the 35 USC 103 rejections which rely on the 
Liddy patent as a primary reference, and which rely on the 
Examiner's interpretation of supposedly anticipatory 
teachings of the Liddy patent, remain. Appellants' attorney 
has pointed out to the Examiner that it is both inconsistent 
and untenable to withdraw the rejections and yet maintain 
reliance on the conclusions found in those rejections. 

Appellants' attorney suggested to Examiner Truong that 
the appropriate result of the Pre-Appeal Brief Review 
conference should have been withdrawal of the Final Office 
Action and re-opening of the prosecution of the application. 
The recommended action, however, has not been taken. As a 
part of the Appeal, therefore, Appellants request review of 
the appended Notice of Panel Decision from Pre-Appeal Brief 
Review. While Appellants ultimately seek reversal of all of 
the Examiner's rejections, Appellants believe that the 
Examiner's actions in response to the Pre-Appeal Brief 
Request for Review and throughout the course of prosecution 
of the subject application have forced Appellants to expend 
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considerable amounts on unnecessary filing fees and to incur 
considerable preparation fees. Accordingly, Appellants seek 
review of the prosecution history of the application to 
determine not only the patentability of Claims 1-15 but also 
to determine whether Appellants should be entitled to 
reimbursement of filing fees. 

Claims 1, 9 and 18 

35 USC 102 (e) rejection as anticipated by Liddy 

Independent Claims 1, 9 and 18, as well as dependent 
claims 2 and 10, were rejected under 35 USC 102(e) as being 
anticipated by Liddy. While these rejections may have been 
withdrawn, Appellants will address the Examiner's 
application of the Liddy teachings to the claim language, 
since the Examiner' s conclusions with respect to Liddy are 
relied upon in subsequent rejections discussed below. 

The Liddy patent is directed to a system and method 
wherein a GUI allows a user to "interact with the computer- 
generated query representation" (Col. 7, lines 35-45) and to 
"re-submit a query based on the contents of documents 
considered highly relevant" (Col. 27, lines 10-25). Liddy 
accepts "natural language" input from a user, interprets the 
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natural language input to correlate it to search terms used 
to categorize documents in a document database and thereby 
generate a usable search query representation, and then 
shows the generated search query representation to the user. 
The user may edit the generated search query representation 
if it is not what the user meant. Thereafter, the Liddy 
system searches the document database using the generated 
search query representation. Liddy retrieves documents 
which are most relevant to the search query and presents the 
list of documents to the user. The user may then select 
documents for viewing. If the user is dissatisfied with the 
query results, the process is restarted with a new natural 
language query. In detailing what is meant by re-submitting 
the query, Liddy teaches at Col. 35, lines 25-35 that a user 
may mark relevant documents (with such system-provided 
designations as "more like") after which the system can 
generate a new query representation. 

Appellants respectfully assert that Liddy does not 
anticipate the invention as claimed. It is first to be 
noted that Liddy provides searching of a document database, 
while the present invention provides retrieval of 
multidimensional data from a database. Liddy generates 
query representations using the fixed word search indexes 
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that are used to classify documents in the document 
database- The present application explains that the 
indexing of multidimensional data in a database, and the 
retrieval of multidimensional data from a database, is 
significantly more complex than indexing and retrieving 
documents in a document database. Multidimensional data 
should be indexed not only according to fixed word search 
type of indexes, as would be used for documents in a 
document database, but also along various other content and 
context measures or characterizations (e.g., temporal 
indexing, spatial indexing, etc) and relationships (e.g., 
semantics) . Under the present invention, retrieval of 
multidimensional data is facilitated by dynamically 
transforming the database in response to a user's query. 
Liddy does not teach or suggest the indexing or searching of 
a multidimensional database or the transforming of a 
database in response to a user query. 

With reference to the first feature of independent 
method Claim 1, which parallels the language of the other 
independent claims, Appellants acknowledge that Liddy 
searches a database to retrieve data in response to a user 
query. Liddy does not, however, search a multidimensional 
database in response to a user query. 
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With regard to the claim feature of presenting 
retrieved data to a user, Appellants acknowledge that Liddy 
presents a list of documents to a user. Liddy does not, 
however, present retrieved multidimensional data to a user. 

With regard to the claim feature of receiving user 
input based on the retrieved data, Appellants acknowledge 
that Liddy accepts user input, since the Liddy user can mark 
documents as "most like" what they were searching for "which 
causes the query representation to be modified in view of 
the documents and the refined query to be rerun" (Col. 28, 
lines 37-40) . As above, Appellants maintain that Liddy does 
not perform the foregoing in the context of multidimensional 
data . 

The Liddy patent does not teach or suggest the claim 
feature of transforming a database based on user input to 
generate a transformed database. The Examiner notes that 
Liddy' s "matcher determines the similarity between query and 
documents" and then concludes that the "above information 
shows that each document is converted by changing similarity 
measure of each document". Appellants respectfully 

disagree. Determining a similarity measure between a 
document and a query does not result in any change to the 
document. Liddy does not change the document and does not 
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change the document database. Accordingly, it cannot be 
concluded that Liddy teaches or suggests transforming the 
database. 

The Examiner further concludes that "the transforming 
of each document comprises changing distance/similarity 
measure with the document for the refined query or each time 
user's input" (sic). Appellants again contend that 
computing a new similarity measure does not results in any 
change to the document or the document database. 

With regard to the claim feature of successively 
searching the transformed database to retrieve data, 
Appellants note that the Examiner cites the claim feature as 
"successively searching the transformed database to 
retrieved data" (emphasis added) . The incorrect word may be 
the result of a typographical error; however, Appellants 
bring the error to the attention of the Board since such an 
error in understanding the claim term may contribute to the 
Examiner's misinterpretation of the claim feature. The 
Examiner states that Liddy' s matcher output "is a ranked 
list of documents assigned to folder and the rank position 
of a document with each folder is determined by a similarity 
score computed in DR-Link matcher." Steps of retrieving 



YOR919980220US1 



-18- 



Serial No. 09/237 , 646 

documents and ranking them by similarity score do not teach 
or suggest successively searching a transformed database. 

Finally, with regard to the claim feature of repeating 
steps b through e until the results satisfy the query, the 
Examiner points to the Liddy process flow illustrated in 
Figs. 9A and 9B which shows that a, if a user selects the 
"refine query'' option and marks documents for relevance 
feedback, the Liddy system will begin a new search. 
Appellants contend, however, that Liddy is not repeating 
steps of presenting retrieved multidimensional data to a 
user, receiving user input based on the retrieved 
multidimensional data, transforming the database based on 
user input to generate a transformed database and 
successively searching the transformed database. 

Anticipation under 35 USC 102 is established only when 
a single prior art reference discloses each and every 
element of a claimed invention. See: In re Schreiber , 128 
F. 3d 1473, 1477, 44 USPQ2d 1429, 1431 (Fed. Cir. 1997); In 
re Paulsen , 30 F. 3d 1475, 1478-1479, 31 USPQ2d 1671, 1673 
(Fed. Cir. 1994); In re Spada, 911 F. 2d 705, 708, 15 USPQ2d 
1655, 1657 (Fed. Cir. 1990) and RCA Corp. v. Applied Digital 
Data Sys., Inc. , 730 F. 2d 1440, 1444, 221 USPQ 385, 388 
(Fed. Cir. 1984) . Since the Liddy patent does not teach 
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means or steps for retrieving multidimensional data from a 
database in response to a user query including steps and 
means for receiving user input based on retrieved 
multidimensional data and transforming the database based on 
the user input to generate a transformed database, it cannot 
be maintained that Liddy anticipates the invention as 
claimed in the independent Claims 1, 9 and 18. 

Claims 1, 9 and 19 

35 USC 102(e) rejection as anticipated by De Bonet 

Independent Claims 1, 9 and 18, as well as dependent 
claims 2 and 10, were rejected under 35 USC 102(e) as being 
anticipated by De Bonet. 

Appellants point out the error on page 8 of the Office 
action noting that the Examiner stated "[a]s to claims 1 and 
9, Liddy teaches the claimed limitations:" instead of 
stating "De Bonet teaches the claimed limitations". In 
spite of the error, Appellants address the rejections as if 
directed to De Bonet 

The De Bonet patent is directed to a system and method 
for image retrieval. Under De Bonet, images in an image 
database are indexed by image "signatures" which are 
generated by iterative multi-level convolution filtering of 
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pixel values for each color axis of the image (Col. 6, lines 
12-16) . When a query is to be conducted, the user supplies 
a group of so-called query images in which each image is 
structurally similar to the images that the user wants to 
find (Col. 6, lines 1-4). The system computes a signature 
for each query image (Col. 13, lines 20-24) and computes 
average variance vectors for the query image signatures 
(Col. 13, lines 27-28). Thereafter, the system compares the 
query image signature information to image information for 
successive "test" images and produces similarity measures 
for each test image in the database (Col. 13, line 45 
through Col. 14, line 19). The test images are ranked by 
descending similarity measure (Col. 14, lines 19-22) and 
after all images in the image database have been processed, 
the images with the highest similarity measures are 
displayed to the user (Col. 14, lines 24-36). De Bonet also 
teaches that a user may provide a textual description of an 
image that is to be stored by the system. The textual 
description may be stored with the image signature and the 
user may specify a textual query rather than an image query 
(Col. 22, lines 40-48) . 

Appellants respectfully assert that De Bonet does not 
anticipate the invention as claimed. 
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With reference to the first feature of independent 
method Claim 1, which parallels the language of the other 
independent claims, Appellants acknowledge that De Bonet 
searches a database to retrieve data in response to a user 
query. De Bonet does not, however, search a 

multidimensional database in response to a user query. 

With regard to the claim feature of presenting 
retrieved data to a user, Appellants acknowledge that De 
Bonet presents retrieval results (i.e., images or image 
pointers) to a user. De Bonet does not, however, present 
retrieved multidimensional data to a user. 

With regard to the claim feature of receiving user 
input based on the retrieved data, the Examiner has cited 
the teachings found in Col. 22 of De Bonet. De Bonet 
teaches that a user may input a textual query, "preview the 
query image (s)" retrieved by the system in response to the 
textual query and then select some of the retrieved images 
to serve as query images. As above, Appellants maintain 
that De Bonet does not perform the foregoing in the context 
of multidimensional data. 

The De Bonet patent does not teach or suggest the claim 
feature of transforming a database based on user input to 
generate a transformed database. The Examiner cites the De 
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Bonet teachings (Col. 22, line 60-Col. 23, line 7) related 
to comparing image vectors to yield similarity measures. 
However, generating similarity measures is not the same as 
or suggestive of transforming a database. The Examiner also 
cites the teachings at Col. 12, lines 55-60 in which De 
Bonet teaches precomputing signatures for test images. 
Precomputing a signature for a stored image is not 
transforming the database. Even in the De Bonet embodiment 
where signatures are not precomputed but are computed as 
each "test" image is considered, the image database is not 
being transformed. The Examiner also cites the teachings 
found in Col. 13, lines 15-45 which discuss computing 
signatures for query images, computing vectors and sending 
the information to the comparison engine. Nothing in the 
cited passages teaches or suggests transforming a database. 
As noted above, determining a similarity measure between 
stored data and a query does not result in any change to the 
stored data. De Bonet does not change the image and does 
not change the image database. Accordingly, it cannot be 
concluded that De Bonet teaches or suggests means or steps 
for transforming the database. 

With regard to the claim feature of successively 
searching the transformed database to retrieve data, 
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Appellants note that the Examiner again cites the claim 
feature as "successively searching the transformed database 
to retrieved data" (emphasis added) . The Examiner cites the 
passage from Col. 23, lines 1-15 which teaches that a user 
may refine his/her textual query "to engender additional or 
substitute query images, for preview, and associated 
signatures for subsequent use during image retrieval." 
Modifying a query to send to the same database does not 
result in successive searching of a transformed database. 

Finally, with regard to the claim feature of repeating 
steps b through e until the results satisfy the query, the 
Examiner points to the same De Bonet teachings from Col. 23, 
lines 1-15 discussed in the preceding paragraph. The cited 
passage teaches that the user can modify the textual query 
to pull up different query images. The passage does not 
teach or suggest repeating steps of presenting retrieved 
multidimensional data to a user, receiving user input based 
on the retrieved multidimensional data, transforming the 
database based on user input to generate a transformed 
database and successively searching the transformed 
database. The Examiner additionally cites the passage found 
in Col. 15, lines 1-7 which teaches that the user can 
instruct the image retrieval and display manager to use any 
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retrieved image as an additional query image in order to 
refine the subsequent retrieval operation for that query. 
Selecting an image to serve as a query image for searching a 
fixed image database does not anticipate the repeating of 
presenting retrieved multidimensional data to a user, 
receiving user input based on the retrieved multidimensional 
data, transforming the database based on user input to 
generate a transformed database and successively searching 
the transformed database. 

Anticipation under 35 USC 102 is established only when 
a single prior art reference discloses each and every 
element of a claimed invention. See: In re Schreiber , 128 
F. 3d 1473, 1477, 44 USPQ2d 1429, 1431 (Fed. Cir. 1997); In 
re Paulsen , 30 F. 3d 1475, 1478-1479, 31 USPQ2d 1671, 1673 
(Fed. Cir. 1994); In re Spada, 911 F. 2d 705, 708, 15 USPQ2d 
1655, 1657 (Fed. Cir. 1990) and RCA Corp. v. Applied Digital 
Data Sys., Inc. , 730 F. 2d 1440, 1444, 221 USPQ 385, 388 
(Fed. Cir. 1984) . Since the De Bonet patent does not teach 
means or steps for retrieving multidimensional data from a 
database in response to a user query including steps and 
means for receiving user input based on retrieved 
multidimensional data and transforming the database based on 
the user input to generate a transformed database, it cannot 
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be maintained that De Bonet anticipates the invention as 
claimed in the independent Claims 1, 9 and 18. 

Claims 1, 9 and 18 

35 USC 103(a) as unpatentable over Liddy in view of Jain 

Independent Claims 1, 9 and 18 have also been rejected 
as unpatentable over Liddy in view of Jain. Appellants rely 
on the arguments presented above with respect to the 
teachings of the Liddy patent. The Examiner has stated on 
page 12 that "Liddy does not explicitly the (sic) claimed 
limitation 'retrieving multidimensional data from a database 
in response to a user query'." The Examiner cites the Jain 
patent as teachings retrieving image as multidimensional 
data from a database in response to a user query and cites 
Col. 4, lines 30-55 of Jain. The cited passage teaches that 
Jain stores a set of feature vectors for stored images. 
Appellants contend that, even if one were motivated to store 
images with feature vectors in the Liddy system, one would 
not arrive at the invention as claimed. Neither Liddy nor 
Jain provides any teaching of means or steps for effecting 
transformation of a database based on user input to generate 
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a transformed database and then successive searching of the 
transformed database. 

It is well established under U.S. Patent Law that 
obviousness can only be established by combining or 
modifying the teachings of the prior art to produce the 
claimed invention when there is some teaching, suggestion, 
or motivation to do so found either in the references 
themselves or in the knowledge generally available to one of 
ordinary skill in the art (In re Fine, 837 F. 2d 1071, 5 
USPQ2d 1596 (Fed. Cir. 1988) and In re Jones, 958 F. 2d 347, 
21 USPQ2d 1941 (Fed. Cir. 1992)). Applicants respectfully 
assert that there are no teachings, suggestions, or 
motivations provide by the Liddy patent or the Jain patent 
to modify the Liddy system in such a way as to obviate the 
invention as claimed. Neither reference teaches or suggests 
transforming its database as claimed; neither teaches or 
suggests searching a transformed database; and, neither 
teaches or suggests iteratively repeating the steps of 
receiving user input to retrieved results, transforming the 
database, and successively searching the transformed 
database until a user query is satisfied. 

For a determination of obviousness, the prior art must 
teach or suggest all of the claim limitations. "All words 
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in a claim must be considered in judging the patentability 
of that claim against the prior art" (In re Wilson, 424 F. 
2d 1382, 1385, 165 U.S.P.Q. 494, 496 (C.C.P.A. 1970). If 
the cited references fail to teach each and every one of the 
claim limitations, a prima facie case of obviousness has not 
been established by the Examiner. Accordingly, Appellants 
conclude that the Examiner has not established a prima facie 
case of obviousness against the language of Claims 1, 9 and 
18. 

Claims 2 and 10 

35 USC 103(a) as unpatentable over Liddy in view of Jain 

Claims 2 and 10 have also been rejected as unpatentable 
over Liddy in view of Jain. Claims 2 and 10 depend from 
Claims 1 and 9 respectively and recite method and program 
storage device, respectively, wherein the method further 
comprises reformulating the query based on said user input 
and wherein said searching said transformed database 
comprises searching said transformed database based on said 
reformulated query. The Examiner cites the Liddy patent 
teachings from Col. 28, lines 30-40 regarding user input to 
change the folders in which retrieved documents are stored 
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and to mark documents using the "most like" designation. 
While Liddy does accept user input, and may use the "most 
like" designation in a subsequent query, Liddy is not 
providing a reformulated query to search a transformed 
database, as is claimed by Claims 2 and 10. The cited 
passage from Col. 21, lines 25-67 details the operations of 
Liddy' s matcher which compares database documents to the 
query. There is nothing in the description of the matcher 
which teaches or suggests reformulating a query and 
searching a transformed database with a reformulated query. 
Finally, the Examiner cites the passage on computing 
similarity measures from Col. 22, lines 1-35. Appellants 
reiterate that computing similarity measures does not result 
in transformation of the stored documents or of the document 
database. 

Applicants reiterate that, for a determination of 
obviousness, the prior art must teach or suggest all of the 
claim limitations (In re Wilson, 424 F. 2d 1382, 1385, 165 
U.S.P.Q. 494, 496 (C.C.P.A. 1970). If the cited references 
fail to teach each and every one of the claim limitations, a 
prima facie case of obviousness has not been established by 
the Examiner. Accordingly, Appellants conclude that the 
Examiner has not established a prima facie case of 
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obviousness against the language of Claims 2 and 10 using a 
combination of teachings from Liddy and Jain. 

Claims 2 and 10 

35 USC 103(a) as unpatentable over De Bonet in view of Jain 

Claims 2 and 10 have also been rejected as unpatentable 
over De Bonet in view of Jain. Applicants rely on the 
discussion of the De Bonet patent provided above. In 
rejecting Claims 2 and 10, the Examiner states that "De 
teaches the claimed limitation *ref ormulating the query 
based on user input and wherein said searching said 
transformed database comprises searching said transformed 
database based on said reformulated query". The Examiner 
does not provide citation to any of the De Bonet patent 
teachings in reaching that conclusion. The Federal Circuit 
has stated that when patentability turns on the question of 
obviousness, the obviousness determination "must be based on 
objective evidence of record" and that "this precedent has 
been reinforced in myriad decisions, and cannot be dispensed 
with." ( In re Lee , 277 F. 3d 1338, 1343 (Fed. Cir. 2002)). 
Moreover, the Federal Circuit has stated that "conclusory 
statements" by an examiner fail to adequately address the 
factual question of motivation, which is material to 
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patentability and cannot be resolved "on subjective belief 
and unknown authority" (Id^ at 1343-1344). Accordingly , 
Applicants believe that the Examiner erred in concluding 
that De Bonet teaches the claimed limitation without 
providing any supporting teachings from De Bonet. 

The Examiner further states that "Jain teaches sends 
(sic) refinement parameters based on user input to a query 
refinement for modification of a query". The Examiner 
further states that "[t]he query refinement processor may 
send a new query structure for refinement of the database 
query to query processor to produce a new set of query 
results (col. 4, lines 42-48)". Jain does teach refinement 
of a query; however, there is nothing in the cited passage 
which teaches or suggests searching a transformed database 
with a reformulated query. Applicants reiterate that, for a 
determination of obviousness, the prior art must teach or 
suggest all of the claim limitations (In re Wilson, 424 F. 
2d 1382, 1385, 165 U.S.P.Q. 494, 496 (C.C.P.A. 1970). 
Accordingly, Appellants conclude that the Examiner has not 
established a prima facie case of obviousness against the 
language of Claims 2 and 10 using a combination of teachings 
from De Bonet and Jain. 



YOR919980220US1 



-31- 



Serial No. 09/237,646 



Claims 3-4 and 11-12 

35 USC 103(a) as being unpatentable over Liddy in view of 
Jain and further in view of Kirsch 

Appellants rely on the discussions of the Liddy and 
Jain patents provide above. With regard to Claims 3 and 11, 
the Examiner has concluded that "Liddy does not explicitly 
teach the claimed limitation "extracting indices from said 
database and wherein said searching is preceded by 
retrieving indices to focus said search on indexed 
information in said database'." With regard to Claims 4 and 
12, the Examiner states that "Liddy does not explicitly 
teach the claimed limitation 'applying said extracted 
indexes (sic) to said transformed database'." 

The Kirsch patent teaches that individual collection 
indexes can be transmitted over the internet to a meta index 
processor. The Kirsch patent does not extract the indexes 
from the database to be searched. Accordingly, Appellants 
contend that the Examiner erred in concluding that Kirsch 
teaches the limitation set forth in Claims 3 and 11. 
Further, Kirsch does not apply the extracted indexes to the 
same database from which it extracted the indexes, nor does 
Kirsch teach or suggest applying indexes to a transformed 
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database, as is expressly recited in Claims 4 and 12. 
Appellants further aver that the dependent claims include 
all of the limitations of the claims from which they depend, 
as well as the limitations of any intervening claims. Since 
none of the cited references teach all of the limitations of 
the independent claims, then clearly obviousness has not 
been established against the claims which depend therefrom. 

For a determination of obviousness, the prior art must 
teach or suggest all of the claim limitations. "All words 
in a claim must be considered in judging the patentability 
of that claim against the prior art" (In re Wilson, 424 F. 
2d 1382, 1385, 165 U.S.P.Q. 494, 496 (C.C.P.A. 1970). Since 
the combined references fail to teach each and every one of 
the claim limitations, a prima facie case of obviousness has 
not been established by the Examiner. 

Claims 3-4 and 11-12 

35 USC 103(a) as being unpatentable over Liddy in view of 
Kirsch 

Applicants rely on the discussion presented above with 
regard to the teachings of Kirsch as applied to a 
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combination of Liddy and Jain in response to the rejection 
of Claims 3, 4, 11 and 12. 

Since the anticipation rejection of the independent 
claims, Claims 1 and 9, from which the Claims 3-4 and 11-12 
respectively depend, has been withdrawn, Applicants believe 
that this rejection should have been withdrawn as well. 

Claims 3-4 and 11-12 

35 USC 103(a) as being unpatentable over De Bonet in view of 
Jain and further in view of Kirsch 

Appellants rely on the arguments set forth above with 
regard to the teachings of the De Bonet, Jain and Kirsch 
patents. Appellants respectfully conclude that the Examiner 
has not established a prima facie case of obviousness 
against the Claim 3, 4, 11 and 12 since none of the De 
Bonet, Jain or Kirsch patents teaches the claimed steps and 
means for extracting indices and applying extracted indices 
to a transformed database, including all of the limitations 
of the claims from which they respectively depend. 
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CONCLUSION 



Appellants respectfully assert that the Examiner has 
erred in issuing a Restriction Requirement after five years 
of prosecution; has erred in issuing a Final Office Action 
at this juncture in the prosecution; has erred in not 
withdrawing the Final Office Action based on the conclusions 
of the Pre-Appeal Brief Review; and has erred in rejecting 
Claims 1-4, 9-12 and 18, Appellants request that the 
decisions of the Examiner be overturned by the Board and 
that the claims be passed to issuance. 



Respectfully submitted, 
V. Castelli, et al 



Anne Vachon Dougherty 
Registration No. 30,374 
Tel. (914) 962-5910 
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APPENDIX OF CLAIMS 

1. A computerized method for retrieving multidimensional 
data from a database in response to a user query, comprising 
the steps of: 

a. first searching said database to retrieve data based on 
said query; 

b. presenting retrieved data to user; 

c. receiving user input based on said retrieved data; 

d. transforming said database based on said user input to 
generate a transformed database, wherein said transforming 
comprises at least one of modifying a linear transform 
matrix of the database, transforming the feature space of 
the database, changing distance/similarity measures within 
said database, and changing weighting features within said 
database; 

e . successively searching said transformed database to 
retrieve data; and 

f. repeating steps b through e until the results for the 
said query is satisfied. 

2. The method of Claim 1 wherein said step of transforming 
said database further comprises reformulating the query 
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based on said user input and wherein said searching said 
transformed database comprises searching said transformed 
database based on said reformulated query. 

3. The method of Claim 1 further comprising extracting 
indices from said database and wherein said searching is 
preceded by retrieving indices to focus said search on 
indexed information in said database. 

4. The method of Claim 3 wherein said successively searching 
transformed database comprises applying said extracted 
indices to said transformed database. 

5. (withdrawn) Apparatus for performing retrieval of 
information in response to a user query in a system having 
at least one client location and at least one server 
location comprising: 

a. at least one database storing said information at 
said at least one server; 

b. a multidimensional indexing engine at said at least 
one server for maintaining indices related to information in 
said at least one database and for retrieving said indices 
in response to said query; 
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c. a similarity query engine at said server for 
conducting searches of said at least one database in 
response to a query; 

wherein said similarity query engine receives 
information regarding said retrieved indices from said 
multidimensional indexing engine for identifying database 
areas to be searched. 

6. (withdrawn) The apparatus of Claim 5 further comprising 
means for displaying retrieved information at said client 
location and for receiving user input regarding said 
retrieved information. 

7 . (withdrawn) The apparatus of Claim 6 wherein said 
multidimensional indexing engine is adapted to refine said 
indices based on said user input. 

8. (withdrawn) The apparatus of Claim 6 wherein each of said 
at least one server location additionally comprises 
processor means for reformulating said query based on said 
user input. 
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9. A program storage device readable by machine, tangibly 
embodying a program of instructions executable by the 
machine to perform method steps for retrieving 
multidimensional data from a database in response to a user 
query, said method steps comprising: 

a. first searching said database to retrieve data based on 
said query; 

b. presenting retrieved data to user; 

c. receiving user input based on said retrieved data; 

d. transforming said database based on said user input to 
generate a transformed database, wherein said transforming 
comprises at least one of modifying a linear transform 
matrix of said database, transforming the database feature 
space, changing distance/similarity measures within said 
database, and changing weighting features within said 
database; ; 

e. successively searching said transformed database to 
retrieve data; and 

f. repeating steps b through e until said query is 
satisfied. 

10. The device of Claim 9 wherein said method step of 
transforming said database further comprises reformulating 
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the query based on said user input and wherein said 
searching said transformed database comprises searching said 
transformed database based on said reformulated query. 

11. The device of Claim 9 wherein said method further 
comprises extracting indices from said database and wherein 
said searching is preceded by retrieving indices to focus 
said search on indexed information in said database. 

12. The device of Claim 11 wherein said successively 
searching transformed database comprises applying said 
extracted indices to said transformed database. 

13. (withdrawn) A method for performing retrieval of 
information in response to a user query in a system having 
at least one client location and at least one server 
location comprising the steps of: 

a. storing information in at least one database at 
said at least one server; 

b. maintaining indices related to information in said 
at least one database; 

c. receiving a query; 

d. retrieving said indices in response to said query; 
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e. identifying database areas to be searched based on 
said retrieved indices; and 

f. conducting searches of said at least one database 
of said areas to be searched in response to said query. 

14 . (withdrawn) The method of Claim 13 further comprising 
displaying retrieved information at said client location and 
receiving user input regarding said retrieved information. 

15. (withdrawn) The method of Claim 14 further comprising 
refining said indices based on said user input. 

16. (withdrawn) The method of Claim 13 further comprising 
reformulating said query based on said user input. 

17. (withdrawn) A program storage device, readable by 
machine, tangibly embodying a program of instructions 
executable by the machine to perform method steps for 
retrieval of information in response to a user query in a 
system having at least one client location and at least one 
server location, said method comprising the steps of: 

a. storing information in at least one database at 
said at least one server; 
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b. maintaining indices related to information in said 
at least one database; 

c. receiving a query; 

d. retrieving said indices in response to said query; 

e. identifying database areas to be searched based on 
said retrieved indices; and 

f . conducting searches of said at least one database 
of said areas to be searched in response to said query. 

18. A system for retrieving multidimensional data from a 
database in response to a user query, comprising: 

a. a search component for searching said database to 
retrieve data based on said query; 

b. a presentation component for presenting retrieved data to 
user; 

c. a receiver component for receiving user input based on 
said retrieved data; 

d. a transformation component for transforming said database 
based on said user input to generate a transformed database, 
wherein said transforming comprises at least one of 
modifying a linear transform matrix of the database, 
transforming the feature space of the database, changing 



YOR919980220US1 



-42- 



Serial No. 09/237,646 

distance/similarity measures within said database, and 
changing weighting features within said database, 
wherein said system successively searches said transformed 
database to retrieve data and present retrieved data to the 
user until the query is satisfied. 
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EVIDENCE APPENDIX 

Appellants submit herewith: 

Copies of three Notices of Panel Decision from Pre- 
Appeal Brief Review generated for this application. 

A Declaration of Prior Invention was submitted by 
Applicants on February 21, 2002. A copy of the Declaration 
of Prior Invention is provided herewith. The Declaration of 
Prior Invention is provided for the information of the 
Board, but is not relied upon in the arguments presented 
herein. 
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3 □ Allowable appKcatibiv-frconference has been held: Tbe-r^ectioft.is,vs(ithdrawn and a.Notice of 
Allowance will be mailed RTOeeuaeftoivth^merteFeff ia iii s eluded. Np-ftirther action is required by 
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systems include the IBM Onm, k t - 
W, tk« MTT Pkotob^m^T ""J?" ("B 10 ) »^ W. tt. We rtmal i^™, « 
Syrtm [q. i0,0b00,: » »** a, OCSB ft 2 ], and S^SnS^ 

8earchk «8et- "*»gaised through a ccmbinataon of spectral and texture features)™^ 

™ pohmMc model <rf ti. M ,TZh '*L^ ^ °»<rt goal image. A Baj4ian tamj^oUS 

^^i" tT^^^r^.^ - d — * t~rf»»» baaed notm 
J*™. He linear traaafb™ „f ^llT ^ f """"""^ rf — b thia 

»««rw qnerr enrironment. mamx, Muck makes tl(e 



.... . ,™=n.- *«> the 



1 



of image and 



«sp<2riaQi5atB. 



« and v, tAm Q = ,g» 



vector has a cKmasiakois. 



as: 



St •••» 



1 



(l) 



1 ®g J 
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tmin(njc,no)J 



Bo — V,J (3) 



2 PROPOSED METHOD 



2.1 NonBnear Multidimeiidonai scaling 



ormanmized. F*™«°n wane tne distance between those vectors in different classes is preserved 

^^^r^T^^,^^^ ^ ^ » ^objectiveis to discover 

«*ch that the following cost function * ~ W *) (4) 

is minimized In • J = U - A K. + A/ v 



* _ ^ ^ ^ for all the pain of vectors oefj^ BeW- 



(6) 
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^ere and Wi are the da^labek of vector X.- and x,, and 

fti = If(x.) - f(x,)J = |W(#x,.) - ^ )}J> 
The function Sfa,^) is defined as below: 
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V» are positive weights, defined as 



for Wi — 



(8) 



(9) 



(10) 



(ii) 



"k«« <MX) i. tie Bucftfc*, dutwc. b,t^ ^ Md ^ 

<WX) = l*-x,| 
Tha atractim sieKrving cxitcrion ii defined as bclotr 

^=EE««(»<-^(x)y (12) 

AW = D(V)V 

where 
and 



c 6 (v) = / a «*i( x )/«w(V) (ij)es + £ 

1° «,i)€5o ^ 



(13) 
(14) 

(15) 
(16) 
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4. Perform similaiity search in the scaled feature rt,*™ n.- i - 
!^~*|IHvW-^^ 

(or irrelevant). Assuming that U< and V aie tnTseTtW^!? (« "^^ant and dissimilar 

respectively, ana k, are the sets that mdnde those similar and disrimilarT^ 

5. Update Xt and yj as follows 



Xt = Jf,_, u U u 
l r i = K < _ 1 uF 4 . 



(19) 
(20) 



6. set 1, and return to step 3. 

3 IMPLEMENTATION AND EXPERIMENTS 

The feature vector used in the database ha* oi >^ . 

^on. ccocurr^l^ 6 ^^ sZ^V^^^^ a "* , ~ 
■*ew, dispersion, and Moran ebWcorreS iSwL^I dnfsrenc^based texture features, coarseness, 
random arts ^32x32frS^J^^^ e ^^^^ 1 l 88 feB ° W8: We ***** 32 

A 21-dimensional texture feata~k ^^l^^'^ 1 01 WlUch """^ <rf homogeneous image regions, 
total oTl^nurel^ ^ 15, extracted W each random cut, resulting in a databaTcSnTa 

atr^v^ 

areas used in 4eTbSchWk^ages^^ 3 show examples of mountain, woods, forests, and suburban 

outlined in the^v^^Z?T rt S * rfKise q^*o64. The iterative refinement algorithm 

^wlaS^^^ ^V^T* feahUe VeCtOT8 ^ *■ feature <W The 
the S^Ta ^ ^ ***** * *? Pf^ious section to transform all 

and rexafl vaW 1168X681 n<agW>or » applied tb'deSnnine tSe resulting precision 

49- 



NT 



irrTL_yr - M, V" r*M 
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W 0>) 
Figure 1: Satellite images of (a) mountain (b) mixed 



area. 



* this case, the Bample^^Xbe^T 1 -* *■ S-STO algorithm is 

20| thus requiring the clustering foacltaTSVQ te ^lonT^ fi-ctkms is 

that S-SUR algorithm produced a S^^l the [9j. It is quite apparent 

The 

better*^ ver^^^ 

5^1Se £ ^TSon 0 Cffi2» « ^ a better ^ of the entire 
«enora*es as the sampJe ~TrednS St^^^^ P< ^ dramatical* 
tay produce a better timing set for the S^TIR^JL^' ««hmques of the space can be applied and 

he number of radial fcZL* A ^ *— ^ » ^ the scope of th^iaper. 

-teHng algorit^a^r^ ^thfpX^ ^ ^ * * ***** *- the TSVQ 
_______ <« the performance. As shown in Kg. 6, a point is reached when 

UHlHV, 



**• Hw tritaoMt wham . 
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Alternatives 

Potential Use 

Potential applications include: 

2. Prvcunonfarming: retrieve locations of ^Kfl followed by a dry summer), 

a soil-boxne disease that infe^f^ developments that a«> . , 

Med * ca ^rnage diagno^ retrieve an MPr • 

»«. The tumors are chanSeZfb^ 1 ^ * ^ that ^ *™<™ located wit*™ «. . 
-^location JS^** ^ *— * - hypXanT^^ 

o0 * w «ui tartan primiti«s.^^^ P att «'Md caipets wfefch consist of a specific spatial anaogement of 
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